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j Hiifl  report  was  prepared  by  the  Systems  Research  Branch,  Human  Engineering  Division,  Aerospace  Medical 

Research  Laboratory,  Wright-Patterson  Air  Force  Base,  Ohio  45433,  under  Project  7184,  “Man-Madiine 
Integration  Technology,”  Task  718414,  “Operatm  Wtwkload  Assessment.”  Mr.  Billy  M.  Crawfoid  was  the 
I Task  Scientist  and  Mr.  William  H.  Pearson  was  the  Principal  Investigator. 

Dau  were  collected  from  F-lllD  piloU  belonging  to  the  27th  Tactical  Flight  Wing  at  Cannon  AFB,  Clovis, 
New  Mexico,  and  F>15  pUott  belonging  to  the  Ist  Tactical  Fighter  Wing,  Lani^ey  AFB,  Newport  News, 
Virginia.  The  authors  wish  to  thank  Headquarters  Tactical  Air  Command  for  granting  permission  to  interview 
these  pilots  and  especially  to  thank  these  men  for  contributing  their  knowledge  and  time  so  freely  and  making 
this  study  possible.  Any  usefulness  this  report  may  possess  is  because  of  their  experience,  opinions,  and  tactical 
knowledge.  These  symbols  have  been  given  a preliminary  inspection  by  the  members  of  the  Symbology 
Standardization  Committee  (SSCI  created  by  Electronic  Systems  Division,  L.  G.  Hanscom  AFB, 
Massachusetts,  to  propose  a list  of  JTIDS  synd>ols.  In  many  cases  an  exactly  appropriate  symbol  for  the 
tactical  object  or  event  had  not  been  created  by  the  SSC  and  the  authors  accept  full  blame  for  not  reflecting  the 
spirit  and  intentions  of  the  SSC. 


1 


TABLE  OF  CONTENT 


PAGE 


INTRODUCTION 4 

METHOD  5 

Approach 5 

Symbology  Questioiuiarie 5 

Procedure 6 

RESULTS 7 

Symbology  QuestionnaiTe,  Section  1 7 

Symbology  Questionnaire,  Section  II 11 

Perceptual  Teste 11 

DISCUSSION 11 

CONCLUSIONS 13 

APPENDEX  1 - SYMBOLOGY  QUESTIONNAIRE 15 

Introduction 15 

Guidelines 17 

Restrictions 17 

Suggestions 17 

Form  A — Section  1 18 

Designator  Categories 18 

General  Categories 

Section  II 23 

Directions 23 

PERSONAL  DATA  SHEET 29 

APPENDIX  2 - GROUP  DISCUSSIONS 30 

APPENDIX  3 - LISTING  STIMULI  AND  ASSOCIATED  Hr 36 

APPENDIX  4 - CHI  SQUARE  VALUES  COMPARING  CODING  GROUP 

DISTRIBUTIONS  ACROSS  SAMPLES 37 

APPENDIX  5 - DISTRIBUTION  OF  GROUP  I (PICTORIAL)  CODERS  BY 

SAMPLE  PROPORTIONS 40 

APPENDIX  6 - DISTRIBUTION  ACROSS  AUXILIARY  SYMBOLS  OF  CODE  GROUPS  BY 

SAMPLE  PROPORTIONS 45 

APPENDIX  7 - COMMON  DESIGNS  FOR  TACTICAL  SYMBOLS  ORIGINATED  BY 

SUBJECTS : 50 

APPENDIX  8 - MOST  FREQUENT  DESIGNS  FOR  TACTICAL  SYMBOLS 67 

REFERENCES 73 


2 


9t 


U8T  OF  IUUSTRATION8 

FIGURE  PAGE 

1 PREFERRED  CODING  METHODS  BY  OBJECT 9 

2 DISTRIBUTION  OF  SCORES  ON  ROTATED  BLOCKS 12 

U8T  OF  TABLES 

TABLE  PAGE 

1 SUMMARY  OF  PREFERRED  CODING  METHODS  FOR  DESIGNING 

TACTICAL  SYMBOLOGY 10 

2 PERCENTS  OF  SAMPLES  EMPLOYING  VARIOUS  CODING  CLASSES 8 

3 PEARSON  r VALUES  FOR  PERCEPTUAL  TEST  SCORES 11 

4 SCORES  BY  SAMPLE  PERCEPTUAL  TESTS  (MAX  = 1.0)  14 


3 


INTRODUCTION 


The  Joint  Tactical  Information  Diatribution  System  (JTIDS)  is  a digital,  secure,  jam-resistant, 
communication  system  for  real-time  command  and  control  of  combat  operations.  The  system  uses  Time 
Division  Multiple  Access  (TDMA)  to  interconnect  all  system  participants  into  one  common  channel,  or 
network,  for  distribution  of  information.  A m^jor  component  in  the  system  is  the  electronic  display  device  or 
CRT  terminal  with  which  the  pilot  in  an  aircraft  will  receive  and  transmit  tactical  information  such  as  aircraft 
present  position,  position  of  other  aircraft,  ground/air  targets  and  threats,  weather,  and  so  on.  In  order  to 
optimize  the  transfer  of  information  and  retain  a sufficient  quantity  of  information  on  a small  CRT,  it  is 
necessary  to  devise  a set  of  symbols  to  represent  the  tactical  entities  of  concern. 

Essential  JTIDS  information  requirements  for  fighter  aircraft  were  provided  by  the  Air  Force  Tactical  Fighter 
Weapons  Center  (TFWC)  in  September  1975.  Aeronautical  Systems  Division,  Deputy  for  Aeronautical 
Equipment,  Directorate  of  Avionics  Standardization  and  Systems  Architectiu'e  (ASD/AES)  and  Deputy  for 
Engineering,  Directorate  of  Avionics  Engineering  (ASD/ENA),  used  the  TFWC  study  to  derive  a set  of 
information  requirements  which  are  common  across  the  mqor  tactical  missions.  Results  of  preliminary  studies 
indicated  that  additional  work  on  symbology  to  represent  the  information  requirements  was  necessary  and  that 
standardization  of  symbology  was  an  immediate  need.  Standardization  would  avoid  the  current  symbol 
proliferation  trend  by  which  contractors  introduce  their  preferred  symbol  set  with  each  contract  aircraft. 

ASD/AES  formed  a Symbology  Standardization  Committee  iSSC)  in  April  1976  with  members  from 
ASD/AES,  ASD/ENA,  ASD/ENE,  AFFDL,  AMRL,  and  AFAL.  The  purpose  of  the  committee  was  to 
produce  a symbol  set  to  be  used  in  conjunction  with  a JTIDS  display.  This  Phase  I effort  was  completed  in  six 
months  and  because  of  the  short  time  span,  no  experimental  research  could  be  conducted  to  determine  an 
optimal  symbol  set.  The  details  of  this  effort  are  contained  in  ASD  TR-77-31  (Churchwell,  J.,  et  al.,  1977). 

The  SSC  derived  a set  of  symbols  based  on  the  information  requirements  mentioned  above  and  also  based  on 
the  recommendations  of  some  33  Government  and  industry  research  agencies  surveyed  in  the  study.  Follow-on 
recommendations  suggested  by  the  SSC  at  the  end  of  this  first  phase  included:  investigation  of  the  confusion  of 


symbols  both  within  a symbol  set  and  between  symbol  sets;  population  stereotypes  of  symbol  construction;  and 
investigation  of  the  interpretation  and  dynamics  of  the  SSC  symbol  set.  These  recommendations,  along  with 
three  more,  were  suggested  in  order  to  address  the  problem  of  obtaining  an  optimal  symbol  set. 


The  purpose  of  this  report,  then,  is  to  present  the  results  of  a preliminary  investigation  into  the  area  of  JTIDS 
symbol  set  optimization.  All  three  of  the  SSC  follow-on  recommendations  mentioned  above  are  being  pursued 
by  AMRL  at  this  time;  however,  the  following  report  addresses  primarily  population  stereotypes  of  symbol 
construction  and  subjective  comments  on  interpretation  of  the  SSC  symbols. 


METHOD 


APPROACH 

One  straightforward  method  for  Hnduig  the  most  readily  interpretable  symbok  should  be  simply  to  ask 
potential  users  for  their  preferences  and  select  the  modal  responses  for  each  symbol.  Thu  was  the  approach 
used  in  thu  survey.  Subjects  were  given  specific  information  requirements  and  asked  to  construct  symbok  for 
each  requirement.  Population  stereotypes  were  also  considered  in  the  study  as  indicated  below: 


Data  were  obtained  from  three  populations  of  subjects:  53  college  engineering  students,  39  F-lllD  TAC 
pilots,  and  22  F-15  TAC  pilots.  Selection  rationale  for  the  samples  was  as  follows:  It  was  thought  that  college 
students  would  represent  a group  which  was  relatively  uncontaminated  by  Air  Force  training,  experience,  and 
familiarity  with  tactical  mission  information  requirements  such  as  map,  weather,  and  order-of-battle 
symbology.  These  naive  subjects  would  not  have  knowledge  of  existing  symbology  and  thus  would  neither  be 
influenced  nor  inhibited  in  their  construction  of  symbok.  The  F-lllD  pilots  represented  a group  who  use  an 
operational  CRT  for  information  dkplay.  They  are  familiar  with  electronically  dkplayed  symbology  as 
depicted  on  the  Vertical  Situation  Dkplay  and  the  Moving  Map  Dkplay.  Tliese  devices  do  not  approach  the 
complex  symbology  problem  associated  with  the  proposed  JTIDS;  however,  the  investigators  thought  that  it 
would  be  desirable  to  query  a group  that  at  least  had  an  appreciation  for  the  operational  use  of  electronic 
symbology.  The  F*111D  pilots  also  represented  a group  whose  primary  mission  k air-to-ground  oriented.  The 
F-15  pilots  represented  a group  whose  deckions  and  activities  are  centocd  around  the  single-seat  aircraft 
concept.  It  was  believed  desirable  to  obtain  symbol  concepts  from  those  who  will  be  tasked  with  flying  a highly 
complex  aircraft  with  JTIDS  and  doing  it  alone.  The  F-15  pilots  also  represented  a group  whose  mission  was 
primarily  air-to-air  oriented. 

Two  types  of  data  were  collected  from  all  three  sample  populations:  (1)  symbol  formats  for  specific  types  of 
tactical  information  and  (2)  individual  spatial  perception  scores.  In  addition,  data  were  collected  from  the  pilot 
populations  on  general  attitudes  toward  the  JTIDS  concept  and  cockpit  control/dkplay  instrumentation,  and 
[i  also  on  educational  background  and  Air  Force  flying  experience. 

Data  were  collected  manually.  The  instrument  used  for  symbol  format  data  was  a two  part  symbology 
quesUonnaire  developed  in-house  by  the  investigators.  Spatial  perception  scores  were  obtained  using  a portion 
of  the  DiRerential  Aptitude  Test  (DAT)  (Buros,  1941)  and  the  Rotated  Blocks  Test  (Hunter,  1975).  Group 
discussions  were  held  with  pilots  to  obtain  comments  on  the  JTIDS  concept,  and  they  were  also  requested  to 
fill  in  a personal  data  sheet  on  background  and  experience. 


SYMBOLOGY  QUESnONNAIRE 

The  symbology  questionnaire  (Appendix  1)  was  designed  to  survey  ideas  for  specific  symbok  to  represent 
tactical  information  requirements  such  as  those  proposed  for  the  JTIDS  system.  The  purpose  of  the 
questionnaire  was  twofold:  (1 ) to  gain  insight  as  to  the  preferred  design  of  each  symbol  and  (2)  to  determine 
how  well  a subject  remembered  the  meaning  of  the  symbol  he  had  constructed. 

The  two  sections  of  the  questionnaire  were  adminktered  separately.  Subjects  were  not  aware  that  the  second 
section  of  the  questionnaire  would  test  their  ability  to  recall  the  symbok  constructed  in  the  first  section. 
Subjects  were  not  allowed  to  refer  to  the  first  section  while  accomplkhing  the  second  section  of  the 
questionnaire. 

The  first  section  of  the  questioimaire  asked  subjects  to  construct  symbok  lor  45  different  items  of  tactical 
information.  These  hems  were  different  but  not  necessarily  independent.  The  order  in  which  the  hems  were 
presented  suggested  a building-block  approach.  A generic  symbol  was  asked  for  followed  by  requests  for 
subcategories  of  that  generic  symbol.  For  example:  the  sulyects  were  asked  to  construct  a symbol  for  Aircraft 
(in  general).  They  were  then  asked  to  construct  symbok  for  Interceptor,  Bomber,  Helicopter,  and  so  on. 
Further  down  in  the  list  of  items,  symbok  were  requested  for  armament  carried  on  an  aircraft.  It  was 
presumed  that  sul^ects  would  construct  a relatively  independent  generic  symbol  and  then  modify  that  symbol 
with  additional  markings  — alphanumerics,  and  so  on  — to  form  the  dependent  subcategmy  symbol. 
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In  the  second  section  of  the  questionnaire,  the  subjects  were  asked  to  recall  several  of  their  Section  I responses 
in  order  to  combine  independent  and  dependent  symbols  into  five  complex  symbob  having  several  leveb  of 
integrated  information.  For  example,  in  Section  I,  subjects  were  asked  to  construct  symbob  for  Friendly, 
Enemy,  and  Unknown  Aircraft,  and  symbob  for  the  flight  parameters  — Heading,  Airspeed,  Altitude  — and 
symbob  for  the  armament  carried  on  the  aircraft  — Missiles,  Guided  or  Unguided,  and  Nuclear  or 
Conventional.  In  Section  II  the  subject  was  asked  to  draw  a symbol  representing  an  enemy  interceptor  beading 
north  at  high  airspeed  and  altitude  carrying  guided  nuclear  missiles. 

Two  paper  and  pencil  tests  of  spatial  perception  were  administered  to  the  subjects.  These  tests  were 
recommended  by  D.  Hunter  of  AFHRL,  Personnel  Selection  and  Screening  Branch,  Personnel  Lalxuatory, 
Lackland  AFB,  Texas.  These  were  the  Space  Relations  Test  from  the  Differential  Aptitude  Test  (DAT) 
(Buros,  1941),  a test  of  pattern  recognition  (Mental  Measurements  Yearbook,  p.  1046);  and  the  Rotated 
Blocks  Test  (Hunter,  1975),  a test  for  assessing  three  dimensional  vbual  perception.  These  tests  were  given  so 
as  to  establish  a quantitative  index  of  the  subjects’  ability  to  vbualize  oompbx  rebtionriiips  and  to  maintain 
those  rebtionships  while  reconstructing  Bgures  or  integrating  the  Bgures  into  a new  context.  It  was  believed 
that  the  logic  and  thought  processes  required  to  accomplbh  these  tasks  are  similar  to  those  required  for 
constructing  2-dimensional  symbob  to  represnet  real-world,  multi-dimensional  entities  integrating  various 
leveb  of  information. 

After  the  symbology  questionnaire  had  been  completed,  the  TAG  pilots  participated  in  group  discussions.  The 
JTIDS  concept  was  presented  by  the  investigator  as  was  the  uncbssified  portion  of  the  SSC  symbol  set.  No 
attempt  was  made  to  “sell”  JTIDS  or  the  symbol  set.  The  symbob  and  their  use  of  JTIDS  dbplay  were 
expbined  in  an  objective  manner.  A common  set  of  questions  was  asked  (see  Appendix  2)  during  each  of  the 
group  sessions  and  the  discussions  were  tape-recorded.  The  responses  to  questions  published  here  are  verbatim 
in  many  instances;  however,  some  comments  were  added  to  clarify  the  context  of  the  responses  and  in  some 
cases  simultaneous  responses  were  consolidated  into  one  statement.  Subjects  were  asked  to  compare  their 
constructed  symbols  with  the  SSC  symbol  set  and  also  to  give  their  opinion  on  whether  they  felt  the  SSC 
symbols  would  overload  them  with  information.  They  were  also  asked  questions  about  their  preferences  for 
cockpit  controb  with  which  to  interact  with  JTIDS  and  how  they  felt  about  the  dbplay  configurations,  i.e. 
CRT,  HUD,  Helmet  Mounted  Dbplay,  audio  tones,  and  etc. 

Educational  background  and  flying  experience  of  pilots  were  considered  as  having  a potential  relationship  to 
the  other  types  of  data  collected.  A pilot  with  a degree  in  engineering,  for  instance,  might  be  able  to  analyze  the 
drawings  in  the  perception  tests  in  a more  systematic  fashion  than  would  a pilot  with  a degree  in  political 
science.  Flying  experience  which  was  primarily  air-to-ground  might  influence  construction  of  symbob  rebted 
to  that  mbsion.  The  data  were  collected  but  are  not  included  in  the  results.  There  has  been  no  attempt  as  yet  to 
analyze  the  other  data  in  light  of  personal  data  factors,  except  in  a very  general  sense  because  F-111  pilots 
perform  a primarily  air-to-ground  role  and  F-15  pilots  are  primarily  air-to-air. 

PROCEDURE 

The  symbology  questionnaire.  Section  I,  was  administered  to  the  subjects  followed  immediately  by  Section  II. 
No  time  limit  was  set  for  the  completion  of  either  part  — subjects  were  allowed  to  work  at  their  own  pace.  The 
investigators  were  available  to  answer  questions  and  clarify  terms  but  they  did  not  contribute  to  the  actual 
construction  of  symbob. 

Following  completion  of  the  symbology  questionnaire,  the  DAT  was  administered.  Twenty-five  minutes  were 
allowed  for  completion  of  thb  test.  The  Rotated  Blocks  Test  was  then  given  and  no  time  limit  was  set. 
Completion  time  was,  however,  noted  and  was  considered  as  a potential  dependent  variable. 

Group  discussions  with  the  pilots  were  not  held  until  after  the  symbology  questionnaire  had  been  completed. 
This  was  to  ensure  that  the  subjects  would  not  be  influenced  by  a preview  of  the  SSC  symbol  set.  Personal  data 
sheets  were  distributed  to  the  pilots  during  the  sessions,  and  they  were  allowed  to  fill  them  in  at  their  lebure. 
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RESULTS 


SYMBOLOGY  QUESTIONNAIRE.  SECTION  I 

'Fhe  45  symbols  constructed  by  each  subject  were  sorted  into  one  of  four  coding  groups  based  upon  the  types  of 
elements  used  in  the  design  of  the  symbols.  The  four  coding  groups  were  derived  empirically  based  on  the 
, ability  of  the  investigators  to  classify  symbol  elements.  They  are  as  follows: 

Group  I — Pictorial,  real-world  analogies 

Group  II  — Alphanumeric 

Group  III  — Simple  lines  and  curves,  abstract 

Group  IV  — Geometric  shapes,  triangles,  rectangles,  etc. 

The  degree  of  consistency  among  the  subjects  may  be  assessed  by  means  of  the  entropy.  Hr,  of  the  set  of 
symbols  where  Hr  = pilogpi  and  pi  is  the  percent  of  sample  using  the  ith  category  and  the  logarithm  is  to  base 
ten.  (Hr  = “non-metric  variability  of  any  probability  distribution,”  Gamer  and  McGill,  1956). 

Appendix  3 gives  Hr  values  for  the  college  students  and  the  two  pilot  samples.  A high  value  for  Hr  indicates 
high  variability  and  a low  value,  low  variability.  The  students  were  significantly  more  variable  than  either  of 
the  two  pilot  samples.  For  example,  consider  the  symbol  for  aircraft  in  general:  Hr  for  students  was  0.85 
while  Hr  for  F-111  and  F-15  pilots  was  0.44  and  0.55  respectively.  The  least  amount  of  variabUity  was 
demonstrated  by  F-111  pilots  on  the  symbols  for  Initial  Point  and  Radar  Installation  with  Hr  values  of  0.32 
each.  The  highest  variability  was  shown  by  college  students  on  the  symbols  for  designating  Enemy,  Friendly, 
and  Unknown  with  Hr  values  in  the  range  of  1.07  to  1.10.  The  students  were  uniformly  variable  on  most 
symbols  but  less  variable  on  Ships,  Initial  Point,  and  Target.  The  two  pilot  samples  were  equally  variable  on 
34  of  the  45  symbols  — there  being  no  disceraable  pattern  to  the  symbols  on  which  they  were  different. 

The  Hr  values  give  a good  indication  of  the  amount  of  variability  with  respect  to  the  different  coding  styles 
(Groups  I through  IV)  used  by  the  subjects.  In  other  words,  it  says  how  much  the  subjects  varied  between 
coding  groups  while  constracting  the  symbols.  It  does  not,  however,  indicate  which  coding  groups  were  used 
more  frequently.  For  instance,  one  subject  might  bounce  back  and  forth  from  Pictorial  representations  to 
Alphanumeric  representations  and  have  the  same  Hr  as  one  who  used  all  four  coding  styles  in  equal  amounts. 

I 

In  order  to  determine  if  coding  group  preferences  were  a function  of  experience,  Chi  Square  values  were 
^ calculated  within  and  across  the  frequency  distributions  of  coding  groups  by  symbol  using  seventeen  of  the 

^ “conceptually  independent”  symbols.  These  are  the  more  generic  symbols  requested  of  the  subject  such  as 

Aircraft,  Troops,  Radar  Installation  and  etc.  These  were  chosen  for  analysis  because  it  was  probable  that  there 
would  be  no  mixture  of  coding  group  elements  in  those  symbols,  i.e.,  it  was  likely  that  each  of  these  symbols 
could  easily  be  classified  into  one  of  the  fonr  coding  groups  because  they  would  have  no  modifying  or 
dependent  elements  such  as  would  be  required  for  flight  parameters  or  ordnance  carried  and  so  on. 

These  seventeen  symbols  and  the  associated  Chi  Square  values  are  listed  in  Appendix  4.  Chi  Square  values 
greater  than  7.82  indicate  significance  at  least  at  the  .05  level.  For  13  of  the  17  symbols,  it  was  found  that 
students  and  F- 1 1 1 D pilots  have  different  preferences  for  coding  methods.  When  students  were  compared  with 
F-15  pilots,  a coding  preference  was  indicated  on  8 of  the  17  symbols.  The  coding  preference  differences  were 
present  between  the  two  pilot  samples  but  were  definitely  less  than  when  compared  to  student  preferences.  The 
two  pilot  populations  differed  on  5 of  the  17  symbols. 

The  Chi  Square  results  show  that  there  is  a tendency  for  subjects  to  prefer  different  approaches  to  symbolizing 
tactical  information  when  their  experience  is  different.  Another  population  stereotype  factor  is  also  evident  in 
the  measure  of  variability,  Hr,  where  it  was  found  that  students  are  considerably  more  variable  in  their  choice 
of  coding  methods  than  are  pilots.  The  actual  method  preferred  by  each  of  the  three  populations  for  each 
symbol  is  shown  in  Appendix  5 which  is  discussed  below. 

Percentages  of  each  population  sample  using  a particular  coding  group  were  calculated  and  listed  for  each 
symbol  in  Appendix  5.  In  Coding  Group  I (Pictorial),  for  example,  43.4%  of  students,  9.1%  of  F-15  pilots, 
and  2.6%  of  F-lllD  pilots  constructed  Pictorial  representations  for  the  symbol  Target.  Still  looking  at  the 


( 
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symbol  for  Target,  one  does  not  find  a higher  percentage  of  studente  in  any  of  the  other  Coding  Groups  (II, 
III,  IV);  therefore,  the  modal  response  for  students  was  a Pictorial  representation  for  Target.  The  highest 
percentage  of  F-lllD  pilots  and  for  F-15  pilots  is  found  under  Group  IV  (Geometric  Shapes)  for  the  Symbol 
Target.  These  are  89.7%  and  54.5%,  respectively,  and  therefore  the  modal  response  was  Geometric  Shapes  for 
both  pilot  populations. 

Also  listed  in  Appendix  5 are  the  proportions  of  students  and  pilots  whose  symbol  designs  could  not  be 
classified  into  the  four  coding  groups.  Most  of  these  proportions  are  small  but  some  significant  figures  are  as 
follows:  68.2%  of  the  F-IS  pilots  constructed  symbols  for  aircraft  which  could  not  be  classified  into  Groups  I 
through  IV;  52%  of  the  F*lilD  pilots  and  also  college  students  produced  symbok  for  Origin  (friendly,  enemy, 
and  unknown)  which  could  not  be  classified  into  Groups  I throu^^n  IV. 

A summary  of  Appendix  5 k included  on  the  next  page  (Figure  1)  and  shows  in  graphic  form  the  modal 
responses  for  each  symbol  analyzed. 

Briefly  then,  thk  analysis  indicates  that  the  pilots  chose  to  symbolize  these  conceptually  independent 
information  items  by  using  Pictorial  representations  and  Geometric  Shapes  (Groups  I and  IV),  whereas 
students  chose  Pictorial  representations  and  simple  lines  and  curves  (Groups  I and  III)  and  also,  but  to  a lesser 
degree,  alphanumerics  and  Geometric  Shapes.  (Overall,  most  symbok  classified  fell  into  Groups  I and  IV. 

The  preferred  symbol  coding  methods  were  then  resorted  and  luted  (see  Table  1)  across  population  samples 
and  compared  to  the  SSC  recommendations.  As  shovm  in  the  table,  the  pilots’  responses  were  considerably 
different  from  the  students’  and  the  SSC.  Actually,  the  SSC  recommendations  agreed  more  closely  with  the 
students’  preferred  coding  methods.  These  results  might  suggest  that  the  JTIDS  flight  test  symbol  set  may 
cause  some  problems  for  pilots. 

All  of  the  results  discussed  thus  far  have  been  those  related  to  the  symbok  which  represent  generic  or 
conceptually  independent  entities  such  as  aircraft,  ships,  troops,  etc.  A similar  analysis  was  conducted 
using  the  auxiliary  or  conceptually  dependent  symbok  such  as  types  of  aircraft,  types  of  ships,  and  so  on. 


TABLE  2 

PERCENTS  OF  SAMPLES  EMPLOYING  VARIOUS  CODING  CLASSES 

PERCENT  OF  SAMPLE 


CLASSES 

SSC 

STUDENTS 

F-15  PILOTS 

F-llI  PILOTS 

I — Pictorial 

37 

32 

47 

32 

I — Alpha-Numeric 

13 

26 

26 

11 

III  — Simple  Lines 

31 

26 

0 

5 

IV  — Geometric  Shapes 

19 

16 

27 

31 

100 

100 

100 

100 

Appendix  6 contains  the  listing  of  these  dependent  symbok  with  proportions  of  students  and  pilots  who  used 
each  of  the  four  Coding  Groups  (I  through  IV).  In  comparing  these  results  with  the  independent  symbok 
results  discussed  earlier,  students  and  pilots  alike  tended  to  use  alphanumeric  (Group  II)  and  Simple  Lines  and 
Curves  (Group  III)  to  code  the  dependent  or  additional  ii^ormation;  whereas  the  responses  for  the 
independent  symbok  tended  to  fall  into  Pictorial  and  Geometric  classifications  (Groups  I and  IV). 
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Figure  1 . Preferred  Coding  Methods  By  Object 


TABLE  1 


If 
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SUMMARY  OF  PREFERRED  CODING  METHODS  FOR  DESIGNING 
TACTICAL  SYMBOLOGY 


OBJECT,  EVENT,  ETC. 

ssc 

STUDENTS 

SYMBOL  CLASS 
F-I5  PILOTS 

F-Ill  PILOTS 

TARGET 

PICTORIAL 

PICTORIAL 

GEOMETRIC 

GEOMETRIC 

INITIAL  POINT 

— 

ALPHABETIC 

GEOMETRIC 

GEOMETRIC 

SHIPS 

PICTORIAL 

PICTORIAL 

PICTORIAL 

PICTORIAL 

RADAR  INSTALLATION 

PICTORIAL 

PICTORIAL 

PICTORIAL 

PICTORIAL 

WAYPOINT 

LINES,  ETC. 

ALPHABETIC 

GEOMETRIC 

GEOMETRIC 

AIRCRAFT 

LINES,  ETC. 

LINES,  ETC. 

GEOMETRIC 

PICTORIAL 

NUCLEAR  BLAST 

PICTORIAL 

PICTORIAL 

PICTORIAL 

PICTORIAL 

TANKS 

— 

PICTORIAL 

PICTORIAL 

PICTORIAL 

AAA 

ALPHABETIC 

GEOMETRIC 

PICTORIAL 

PICTORIAL 

EMERGENCY  BASE 

GEOMETRIC 

ALPHABETIC 

ALPHABETIC 

GEOMETRIC 

DOWNED  AIRCREW 

LINES,  ETC. 

LINES,  ETC. 

PICTORIAL 

PICTORIAL 

GROUND  TROOPS 

(ORIENTATION) 

PICTORIAL 

(ORIENTATION) 

PICTORIAL 

PICTORIAL 

PICTORIAL 

SAFE  AREA 

UNES,  ETC. 

GEOMETRIC 

ALPHABETIC 

ALPHABETIC 

BASE  OF  ORIGIN 

GEOMETRIC 

GEOMETRIC 

ALPHABETIC 

GEOMETRIC 

SAM  SITE 

— 

ALPHABETIC 

PICTORIAL 

PICTORIAL 

ORIGIN  (FRIENDLY, 
ENEMY,  UNKNOWN! 

GEOMETRIC 

ALPHABETIC 

GEOMETRIC 

ALPHABETIC 

HAND  HELD  SAMS 

ALPHABETIC 

LINES,  ETC. 

ALPHA-NUM 

LINES,  ETC. 

BOMBING  AREA 

LINES,  ETC. 

LINES,  ETC. 

ALPHABETIC 

GEOMETRIC 

CONVOY 

PICTORIAL 

LINES,  ETC. 

PICTORIAL 

PICTORIAL 

HE-78-3-5 
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The  dimensions  of  the  symbol  designs  which  resulted  from  Section  I (rf  the  Symbology  Questionnaiie  are  ji 

presented  m Appendix  7.  Appendix  8 demonstrates  how  each  of  the  sanple  populations  would  have  coded  each 

symbol  based  on  the  modal  responses  shown  in  these  analyses.  « 


SYMBOLOGY  QUESTIONNAIRE,  SECTION  II 

In  Section  II  of  the  Symbology  Questionnaire,  subjects  were  asked  to  combine  some  of  their  previously 
constructed  symbols  into  more  complex  symbols  to  integrate  several  levels  of  informatkm.  This  measured 
their  ability  to  recall  symbol  responses  fitun  Section  I and  evaluated  their  “system”  for  constructing 
symbols.  Evaluation  of  tbe  logic  employed  to  construct  complex  symbols  was  not  a dependent  measure  for  this 
aiudysu  and  was  viewed  by  the  investigators  as  a potential  source  of  novel,  unique,  or  innovative  coding 
techniques.  Recall,  however,  was  a dependent  measure  and  it  seems  that  whatever  the  pilots  were  using 
appeared  to  work  better  for  them  than  the  technique  used  by  the  students.  Ninety-two  percent  of  pilots  scored 
50%  or  greater  on  Part  2,  while  only  forty-nine  percent  of  the  students  did  as  well. 

PERCEPTUAL  TESTS 

Scores  on  the  two  perceptual  tests  were  compared  across  samples  using  percent  correct  as  the  primary 
dependent  variable.  They  were  positively  correlated  yielding  significant  Pearson  r values  for  the  F-lllD  pilots 
and  college  students  (see  Table  3). 

TABLES 


PEARSON  r VALUES  FOR  PERCEPTUAL  TEST  SCORES 


Rotmted 


Sample 

Blocks 

t 

P 

College  Students  (53) 

.59 

5.22 

p<.01 

F-lllDPilote(39) 

.49 

3.42 

p^Ol 

F-15PUou(22) 

.32 

1.51 

p>.10 

Combined  Sample  (114) 

The  scores  were  plotted  in  percentile  distributiona.  The  distributions  of  scores  on  the  Rotated  Blocks  (see 
Figure  2)  yielded  the  greatest  amount  of  separation  am<mg  samples.  The  two  samples  of  pilots  scored 
significantly  h'jher  than  the  college  students  on  the  Rotated  Blocks  (see  Table  3).  The  F-15  pilots  scmed 
higher  than  the  F-lllD  pilots  on  the  Rotated  Blocks  test,  but  the  difference  was  not  significant.  The  students 
and  the  two  samples  of  pilots  had  DAT  scores  %nthin  the  same  approximate  range;  therefme,  those  scores  did 
not  appear  useful  for  discriminating  between  samples.  Unlike  the  DAT  semes,  the  distributions  of  scores  from 
the  Rotated  Blocks  test  enables  one  to  discriminate  bet%¥een  population  samples,  or  at  the  very  least  between 
students  and  pilots.  The  pilots’  scores  were  much  hi^ier  and  suggest  that  they  would  have  greater  ability  to 
visualize  complex  relationships.  This  ability  was  perhaps  reflected  in  their  superim  perfmmance  on  Part  2 of 
the  Symbology  Questionnarie. 


DISCUSSION 

The  choice  of  coding  group  categories  (Groups  I through  IV)  with  which  to  classify  the  constructed  symbols 
was,  admittedly,  somewhat  arbitrary.  It  is  possible  that  a different  classification  scheme  erould  yield  somewhat 
different  results.  If  the  classification  scheme  which  was  used  is  assumed  to  be  adequate,  then  it  >^ppears  to  be 
effective  when  distinguishing  gross  differences  in  coding  methods,  e.g..  Alphanumeric  versi''^  Pictorial.  It 
does,  however,  cover  up  many  small  differences  within  classes. 
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DISTRIBUTION  OF  SCORES  ON  ROTATED  BLOCKS  TEST 


Distribution  of  Scores  on  Rotated  BkidcsTest 


In  order  for  theae  groos  differences  in  coding  methods  to  be  meaningful,  they  must  be  related  to  actual 
performance  on  the  JTIDS,  i.e.,  if  subjects  prefer  Pictorial  symbols,  their  performance  while  using  JTIDS 
should  be  at  its  best  when  Pictorial  symbols  are  employed.  This  lelatkmship  has  not  been  established  by  this 
study.  It  may  be  that  significant  differences  in  symbol  prrfeienoe  do  not  produce  correspondingly  significant 
differences  in  JTIDS  operator  performance.  This  is  certainly  a subject  for  further  investigation. 

Further  experiments  are  currently  bang  planned  so  that  JTIDS  performance  may  be  evaluated. 

Symbol  diacriminabQity  will  be  determined  mathematically  using  a spatial  frequency  analysis.  Approximately 
145  symbols  (including  the  SSC  symbologyl  will  be  analysed  by  Dr.  Mark  Cannon  of  AMRL. 

This  same  group  of  symbols  is  currently  being  used  in  a confusability  study  by  Dr.  Warren  Tekhner  at  New 
Mexico  State  University  under  the  auspices  of  the  Air  Force  Office  of  Sdratific  Research.  Dr.  Tekhner  will 
determine  empirically  the  relative  confusability  of  the  symbob  using  college  studentt  as  subjecU. 

Mr.  Pearson  is  using  this  145-8ymbol  set  in  another  study  to  determine  the  relative  associatkn  values  of 
different  symbols  for  the  same  object.  Response  time  and  errors  are  the  primary  dependent  variables  used  to 
determine  how  easfly  and  how  well  an  association  is  learned  and  how  rapi^y  it  can  be  recalled. 

Results  of  theae  studies  will  be  applied  as  they  become  availabk  to  evcdve  a “Best”  symbol  set  to  be  used  in  a 
JTIDS/Pilot  performance  experiment.  A JTIDS  simulator,  currently  being  install^  by  ASD/EN,  will  be 
used  to  evaluate  pikt  performance  under  realistk  workload  conditions  involving  real-world  Head-Up  and 
Head-Down  Usks.  The  evolving  “Best”  symbol  set  will  be  compared  to  the  SSC  symbol  set  using  several 
misskn  types  and  different  difficulty  levels  of  flight  task  and  JTIDS  informatkn  load. 


CONCLUSIONS 

The  results  from  this  survey  of  pilots  and  college  students  using  a symbology  queatknnaiie  requiring  all 
participants  to  design  sets  of  complex  codes  to  represent  tactical  information  demonstrated  that  there  are 
marked  differences  in  symbol  design  preferences  between  college  students  and  pilots.  The  results  demonstrate 
that  there  are  populatkn  stereotype  effects  on  symbol  design  preference  (Section  I of  the  Symbology 
Questionnaire)  and  also  effects  on  ability  to  recall  and  integrate  various  levek  of  information  when  composing 
a more  complex  symbol  (Questioimaire  Section  II). 

The  data  suggest  that,  at  least,  a rather  small  sample  of  the  potential  JTIDS  users,  pilots,  prefer  a symbol 
coding  strategy  which  is  significantly  different  from  that  proposed  by  the  Symbology  Standardization 
Committee.  The  significance  of  this  difference  has  yet  to  be  deteimined  and  should  be  pursued  via  learning 
and  man-in-the-loop  experiments  and  JTIDS  simulations. 

Based  on  pilot  opinkns  expressed  in  the  group  discuasiooa  and  also  baaed  on  statiatkal  evidence  resulting  from 
the  analyses  in  this  study,  a more  nearly  optimized  symbol  set  for  Air  Force  Tactical  Fighter  Pilots  should  be 
designed  considering  the  following  facbus:  (1)  symbob  should  be  as  raeU'Kk  or  pictorial  as  possible  to 
minimize  recognitkn  and  information  transbtion  time,  (2)  ex  bring  syaabob  lor  tactkal  navigation,  e.g.. 
Waypoint  (or  Checkpoint,  or  Turnpoint),  Initial  Point,  Target,  should  be  need  to  represent  the  same  entities 
they  have  been  associated  with  in  the  past,  and  (3)  the  symbol  set  should  be  etandardbed  at  the  highest  level 
practicable. 
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TABLE  4 


SCORES  BY  SAMPLE  PERCEPTUAL  TESTS  (MAX  = 1.0) 


Routed  Blocks  D.A.  T. 


Sample 

X 

$.d. 

T 

s.d. 

t 

P 

College  Students 

.356 

.218 

.605 

.156 

F-lllDPiloU 

.802 

.174 

.759 

.146 

11.32 

P^Ol 

F-15Piloto 

.862 

.127 

.736 

.115 

12.52 

P'^.Ol 

a 


APPENDIX  1 


QUESTIONNAIRE  AND  PERSONAL  DATA  SHEET 

! 

SYMBOLOGY  QUESTIONNAIRE  i 

INTRODUCTION  i 

This  questicMinaire  will  give  you  an  opportunity  to  reconunend  symbol  formats  tor  use  on  radar-type  | 

cathode-ray-tube  (CRT)  displays.  You  will  create  symbols  to  represent  tactical  informatkm,  such  as  aiicrikft, 
missiles,  ships,  etc.  This  task  %nll  require  you  to  use  both  imagination  and  analytical  thinking  to  project  how  a 
pilot  would  perceive  these  symbols  on  a display.  For  example  (see  Figure  1 ),  would  you  readily  associate  it  with 
an  airplane? 

Some  persons  responding  to  this  questionnaire  vrill  not  have  had  any  aircrew  experience  with  CRT  displays  in 
a cockpit.  We  apologize  to  the  experienced  persons  for  reading  this  but  some  iidormation  is  necessary  for  the 
non-experienced  respondents.  The  rest  of  this  paragraph  is  for  them.  Several  craisiderations  must  be  made 
when  designing  symlwls  for  these  displays.  (1 ) One  important  restriction  influencing  symbol  formats  is  the  size 
of  the  CRT  display.  Often  its  area  is  less  than  18.6  square  inches  (6  inch  diameter  CRT  face).  This  area  might 
represent  20  square  miles.  Therefore,  the  size  of  the  display  restricts  the  fidelity  of  the  symbols.  (2)  The 
‘state-of-the-art’  in  CRT  technology  versus  the  cost  of  the  display  system  influences  the  symbol  formats;  and 
(3)  High  pilot  workload  leaves  less  time  to  read  and  interpret  these  symbols. 

Frequently  it  is  necessary  to  use  several  dimensions  of  a symbol  to  encode  adequate  information  to  describe  a 
potential  threat.  We  would  like  to  show  you  what  we  mean  without  stifling  your  creativity  because  we  will  need 
your  own  ideas  of  what  are  good  symbols  for  various  categories  of  tactical  information.  So,  let  us  use  an 
example  here  from  a different  area  to  illustrate  what  we  mean. 


Suppose  we  wish  to  indicate  symbolically  one  of  these  different  cars  — Chevy,  Ford,  or  Plymouth;  one  of  these 
body  styles  — sedan,  station  wagon,  or  sports  car;  and  one  of  these  horsepower  — 0 — 150,  150 — 200,  or 
200 — 400.  We  use  C for  Chevy,  Ffor  Ford,  and  Pfor  Plymouth  (later  on  in  this  test  the  concept  “designator 
category’’  will  be  defined  as  an  indication  of  origin;  this  scheme  previously  described  is  an  example  of 
“designator  category’’).  We  use  dX  to  represent  a sports  car,  a for  a sedan,  and  a for  a 

station  wagon.  The  number  of  wheels  will  indicate  the  horsepower  of  the  vehicle.  Therefore,  C is  a 

Chevy  sports  car  with  a 0 — 150  h.p.  engine;  a F is  a Ford  station  wagon  with  150 — 200  h.p.;  and  a 

^ bsO  Plymouth  sedan  with  200 — 400  h.p.  So,  you  can  see  how  a compound  symbol  can  be 

constructed  from  several  logically  consistent  parts. 


There  is  a limit  to  the  amount  of  information  which  can  be  represented  on  a symbol.  The  more  complex  the 
symbol  (complex  meaning  the  amount  or  the  number  of  components  of  information),  the  higher  the  workload. 
The  pilot  has  little  time,  sometimes  less  than  a second,  to  view  the  display;  therefore  the  complexity  of  the 
symbol  versus  the  amount  of  salient  information  it  represents  impacts  upon  his  wmrkload.  For  non-pilots  and 
those  unfamiliar  %rith  the  concept  of  workload  when  applied  in  the  cockpit  oivironment,  an  analogy  is 
provided  below. 

Imagine  yourself  driving  a car  at  a high  speed  in  fairly  busy  traffic.  You  have  a CRT  display  on 
your  instrument  panel  within  vieiving  proximity  of  the  speedometer.  The  symbols  you  will  create 
are  to  be  displayed  on  this  CRT.  You  will  be  required  to  recognize  these  symb<ds,  interpret  the 
information,  and  make  some  appropriate  response  independent  of  controlling  the  car  ^ely  in 
the  heavy  traffic. 

This  description  should  help  you  appreciate  symbol  design  problems  associated  with  reducing  operator 
workload. 
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Thia  quMtionnaire  k divided  into  leveral  aectioas.  They  are  as  follows:  (A)  The  Introduction  which  yon  have 
just  completed;  (B)  the  GuideUnet  which  describe  the  task  of  creating  symbob;  (C)  the  Rettrictiont  section  lists 
the  criteria  whidi  you  must  conform  to  when  creating  symbds;  (D)  Suggettiont;  and  (El  the  Test.  Be  sure  to 
read  these  sections  very  cmrefuUy.  If  you  have  any  questions,  ask  the  test  monitor  before  you  begin  the  test. 

QUIDEUNE8 

1.  The  identity  of  a symbol  on  radar>type  display  systems  fall  into  one  of  three  classifications:  friendly, 

unknown,  or  enemy.  These  three  types  will  be  referred  to  as  “designator  categories”  because  these  identify  the 
origin  of  the  potential  threat.  Geometrk  shapes  are  commonly  used  to  define  each  designator  category.  Often 
only  part  of  the  shape  is  used,  for  example  two  sides  of  a trianide  with  a dot  in  its  center  ^ , m4d>t 

represent  a friendly  tank.  The  orientation  of  the  designator  shape  remains  constant,  but  any  additional  symbol 
within  it  might  change  in  orientation. 

2.  You  may  use  all  or  part  of  the  shape  to  create  a symbol.  Since  your  response  is  limited  to  a 3/8  inch  square, 
it  may  not  be  advantageous  to  use  the  entire  shape. 

3.  There  are  several  general  categories  of  targets  to  be  represented  symbolically.  You  are  to  design  these  so 

that  they  can  be  systematically  modified  to  facilitate  representation  of  additional  material.  For  example,  if 
represented  a friendly  aircraft,  then  a friendly  bomber  could  then  be  represented  by  — a modification 

of  the  general  symbol.  Keep  in  mind  that  the  symbol  designs  must  be  systematic  so  that  they  can  be  integrated 
into  a more  complex  symbol.  Design  the  symbols  using  a “building  block”  approach. 

4.  The  additional  dimensions  of  information  you  add  to  the  symbol  to  further  define  the  target  must  remain 
constant  across  designator  categories. 

RESTRICTIONS 

1.  No  more  than  eight  connected  lines  can  be  used  in  designing  a basic  component  of  information  or  a 
designator  category;  a circle  b considered  as  one  line. 

2.  The  symbol  and  its  designator  category  must  be  drawn  within  a 3/8  inch  square  area.  A square  b provided 
for  you  to  maintain  uniform  responses  under  each  category. 

3.  Neither  color,  brightness,  or  shading  can  be  used  as  coding  dimensions. 

4.  Symbob  must  be  the  same  across  designator  categories,  i.e.,  a symbol  for  a bomber  symbol  would  be  the 
same  for  friendly,  enemy,  or  unknown,  except  that  the  designator  shape  would  change  accordingly.  Thb 
restriction  minimizes  the  number  of  symbob  the  pilot  will  have  to  learn  and  therefore  reduce  confusability. 

SUQQESnONS 

1.  Keep  the  symbol  designs  simple. 

2.  If  you  are  not  sure  about  the  legibility  of  a symbol,  hold  the  paper  at  arms  length  and  make  sure  you  can 
clearly  see  all  the  dimensions  of  coded  information. 

3.  You  may  use  alpha-numeric  numbers  in  conjunction  with  the  symbolic  representation. 

4.  You  use  no  more  than  four  lines  of  alpha-numeric  code  in  proximity  of  the  symbol  for  abbreviated  coding  of 
information.  These  lines  of  code  should  fall  within  a 1/2  inch  square  area.  Remember,  the  use  of 
alpha-numeric  is  optional. 


CODE. 


Dengnsymbob  for  the  different  categoriM  listed  below.  Remember  to  keep  them  simpie  tuing  no  more  than  8 
lines  per  oomponent  of  informatioa.  Make  your  responses  in  the  squares  adjacent  to  its  description.  Design 
your  own  designator  category  using  a maximum  of  8 lines.  Read  throng  the  list  of  sthnuli  before  making  a 


response.  You  may  change  a response  at  any  time.  j j is  the  actual  disiday  sixe. 


1 1 

Designator  Categories 

Frintdfy 

Unknown. 

Enemy 

I.  Aircraft  (In  General) 

A.  Aircraft  Type 

1.  Fighter 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

2.  Bomber 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

3.  Helicopter 

1 i 

1 1 

1 1 

1 i 

1 1 

1 1 

1 i 

1 t 

1 1 

1 1 

1 ! 

1 1 

4.  Transport 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

I 1 

1 1 

1 1 

1 1 

5.  Forward  Observer 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

' 1 

( 1 

6.  Reconnaissance 

1 ^1 

1 1 

1 1 

1 i 

1 1 

1 1 

1 i 

1 1 

1 1 

1 1 

1 1 

1 ! 

1 1 

1 1 

7.  Electronic  Jammer 

1 i 

1 1 

1 1 

1 i 

1 1 

1 1 

1 i 

1 1 

1 1 

1 ! 

1 1 

1 1 

8.  Tanker 

1 1 

1 1 

1 1 

( 1 

1 1 

1 ) 

1 1 

1 1 

1 1 

1 1 

1 1 

1 ! 

1 ' 

1 ! 

B.  Aircraft  Armament 
(Draw  on  an  Aircraft) 

1.  Air>to^rottnd  (In  General) 

a.  Guided  Nuclear 

b.  Guided  Conventional 

c.  Freef all  Nuclear 

d.  Freef  all  Conventional 

2.  Air-to- Air  (In  General) 

a.  Guided  Nuclear 

b.  Guided  Conventional 

c.  Unguided  (Rx,  Gun) 
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Friendly 


Deaignntor  Cntegories 
Unknown 


Enemy 


C.  Flight  Parameters 
(Draw  on  an  Aircraft) 


1.  Altitude  = 10,000’ 


2.  Heading  = 270® 


3.  Airspeed  = 500  Knots 


II.  Ships  (In  General) 
A.  Type 


1.  Aircraft  Carrier 


2.  Tanker 


3.  Destroyer'Battleship 


4.  Missile  Ship 


5.  Submarine 


Friendly 


Designetor  Cetegoriet 
Unknown 


Enemy 


III.  Ground  Targets 


A.  Artillery  d Antiaircraft 


B.  Troops 


C.  Tanks 


D.  Convoy 


E.  Radar  Installation 


F.  SAM  Site  (Surface-to*Air  Missile  Site) 


1.  Hand  Held  Sams 


2.  SA-7andSA-8 


IV.  Miscellaneous 


A.  Safe  Area 


1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

r 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 i 

1 1 

1 1 

1 1 

1 i 

1 1 

1 t 

! ! 

1 1 

1 1 

1 1 

I 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

^ 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 i 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 i 

1 1 

I 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

t 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 ! 

1 1 

1 ^1 

1 1 

1 I 

1 1 

1 1 

( 1 

1 1 

1 ^1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

B.  Base  of  Origin 


C.  Nuclear  Blast 


D.  Bombing  Area 


E.  Downed  Aircrew 


F.  IP  (Initial  Point) 


G.  TGT  (Target) 


H.  Waypoint 


Friendly 


Dengnntor  Categories 
Unknown 


I 


I I 


I I 


I 1 


L ! 


I I 


I I 


I I 


I I 


I I 


I 


t 1 


l_  - _ J 


I I 


Enemy 


I 


I I 

I I 

I I 


I 1 


I I 


I I 


I SECTION  2 GOIK. 

I 


SYMBOLOGY  QUESTIONNAIRE 


Directions 

In  this  section  you  will  reproduce  some  of  the  symbok  that  you  previously  created. 


i 
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PERSONAL  DATA  SHEET 


Name: 

Formal  Education:  - 

Rank; 

Age:  

Present  Assignment:  A.F.B. 

Autovon  Number: 

Pilot  Experience: 

Aircraft  Type  Houra 


Estimated  Leave  and  TDY  Schedule 
Leave  Date 

i 


Return  Date 


Do  you  desire  anonymity?  yes  no  Circle  one 

^Return  this  sheet  with  Consent  Form  in  the  self-addressed  envelope. 
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APPENDIX  2 

GROUP  DISCUSSIONS 

1 he  piloto  were  asked  1 1 questions  related  to  the  JTIDS  symbology  following  a briefing  on  the  SSC’s  symbols. 
These  are  listed  below,  along  with  the  responses. 

1.  How  would  you  compare  the  SSC’s  standard  symbol  set  writh  your  set? 

M11D  Pilots 

Group  1 

Should,  as  much  as  possible,  stick  with  j’the  standard  symbok”  (used  in  TAG  map  annotation),  a square  for 
IP,  a triangle  for  target  and  the  — *—  symbol  for  a radar  offset  point.  Should  use  a gun  barrel  for 
artillery,  an  airplane  for  aircraft  (more  graphic  symbols),  symbok  that  look  like  what  they  represent.  If  half 
circle  with  heading  line  k used  for  aircraft  — should  have  the  capability  of  rotating  entire  symbol  to  show 
heading  — not  just  rotation  of  heading  line.  Thus,  the  symbol  would  look  like  an  airplane  all  the  time,  i.e., 
thk  instead  of  this 

Group 2 

Don’t  particularly  care  for  them  (the  SSC  symbol  set).  Symbok  should  look  like  what  they  represent.  The  boat 
( y "7  ) or  the  man  ( ^ ) k more  along  that  line. 

Seems  ridiculous  to  have  symbok  representing  friendly  aircraft.  When  you  look  at  the  scope  (under  stress,  high 
workload)  everything  is  gonna  look  like  the  enemy.  It  makes  more  sense  to  not  display  friendly  aircraft.  The 
symbol  for  friendly  — if  you’re  going  to  use  a curved  circle  — should  be  smiling  ( ) instead  of  ( ) 

frowning.  k currently  map  symbol  for  (offset  aiming  point)  OAP,  and  ^ k target 

sumbol.  Q is  for  IP. 

Groups 

Why  the  departure  from  the  standard  target  symbol  ( ^ ) which  has  beer,  used  for  years? 

Symbol  for  aircraft  (SSC)  is  not  readily  interpreted.  Perhaps  an  elongated  delta  would  be  better.  Don’t  think 
the  homeplate  symbol  ( P ) is  necessary.  You  know  where  homeplate  k. 

(General  agreement  that  alpha  characters  for  designating  type  of  aircraft,  e.g. , K-tanker,  A>attack,  B-bomber , 
Q-drone,  are  fairly  well  standardized  and  useable). 

F-16Plloli 


They  (SSC)  are  simpler  because  there  is  less  information  shown  there.  We  were  under  the  impression  (from  the 
questionnaire)  that  a symbol  should  be  capable  of  indicating  all  the  information  aspects  at  one  time  for  all 
targets,  i.e.,  type  aircraft,  airspeed,  heading,  altitude,  forward  firing  ordnance,  missiles^  bombs,  and  etc.  The 
(SSC)  symbok  are  all  right  the  way  they  are,  especially  if  that  information  can  be  read  out  when  requested 
(abbreviated  information  at  bottom  of  CRT  presented  when  target  symbol  k interrogated  using  the  acqukition 
symbok).  I would  hate  think,  in  the  multi*bogey  environment,  of  all  the  information  being  dkpkyed  on  each 
symbol  — you’d  have  nothing  but  garbage. 
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One  thing  about  the  symbol  for  aircraft  — the  dot  with  the  velocity  vector  ( / ),  what  happens  if  you  have 
target  without  a velocity  vector  (vector  unknown)  you’d  just  end  up  showing  the  dot  and  you  mi|d>t  miss  h. 


i 


One  thing  I’d  like  to  see,  talking  about  ordnance  on  the  aircraft  — I don’t  think  it’s  necessary  to  have  a code 
for  specific  types  of  ordnance  — if  we  could  have  a code  (symbol)  that  indicated  the  target  had  a forward  firing 
ordnance  capability,  regardless  of  type,  I think  I’d  rather  see  that  coded  on  the  target  symbol  rather  than 
having  to  call  it  up  (interrogate  the  symbol  and  get  abbreviated  information  readout).  Two  symbok  for  oiemy 
fighters  — one  drawing  forward  hemisphere  attack  capability,  the  other  showing  rear  hemisphere  attack 
capability.  The  target’s  attack  capability  has  an  immediate  effect  on  the  tactics  I would  employ. 
(NOTE:  These  pUots  responded  to  most  questions  as  if  they  were  only  concerned  with  the  air  superiority,  or 
air-to-air  combat  role  — their  primary  mission  in  the  F-15). 

In  reference  to  the  heading  vector  there  — would  it  be  possible  to  graduate  it  in  terms  of  groundspeed?  If  the 
terget’s  groundspeed  is  6(X)  kts.,  you  would  have  a vector  of  say  X units  in  length.  If  another  target  were  going 
300  kts.,  the  vector  would  be  X/2  units  long. 

2.  Would  you  prefer  your  own  customized  set? 

MUD  Pilot* 

Group  1 

You  might  have  to  provide  a few  optional  symbols  for  a particular  aircraft.  Standardized  symbols  are  most 
probably  the  way  to  go.  Should  be  standardized  at  least  on  the  Wing  ( AF  organizational  unK)  level. 

Group 2 

Need  to  have  symbols  standardized.  Money  for  a custom  input  feature  would  probably  be  wasted.  Feature 
would  probably  not  be  used. 

Group 3 

Standardized  set  is  better. 

MSPilots 

No.  Symbols  are  simple  enough.  There  is  a lot  of  information  that  just  isn’t  there  — depending  on  what  you 
need.  For  example,  the  symbol  for  a ship  — no  problem  recognizing  what  it  is  — but  we  would  be  interested  in 
knowing  whether  h had  surface-to-air  missile  capability.  I would  like  to  see  an  extension  to  the  symbology. 
There  is  a certain  amount  of  more  information  that  should  be  depicted  but  there’s  no  need  for  all  the  available 
information  to  be  depicted. 

3.  Are  the  standerd  symbob  overloading  you  with  information  ? 

MS  Pilot* 

No.  Too  difficult  to  talk  about  symbols  without  a common  base.  Should  be  standardized  across  Department  of 
Defense  or  across  users. 

MllOPfiot* 

Group  1 

Yes,  would  overload  especially  in  Eastern  European  scenario  where  the  scope  would  be  flooded  with  symbds. 
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Groap2 


Aircrew  ii  wturated  with  information  — only  has  time  for  a quick  look  at  scope.  Symbols  are  too  complicated 
— you  have  to  sH  there  and  “read”  them. 

Groups 

(Inans%verto“.  . . are  the  SSC  symbols  too  complicated?”!  The  standard  Army  symbol  for  troops  is  jnai  an 
X.  You  get  so  many  symbob  from  RHAW  system  and  etc.,  that  at  times  the  infocmmion  can  be  detahneotal. 

4.  How  would  you  best  interact  with  the  CRT  display?  Remote  s«ntches?  Pu»h-huttona  on  tho  daMward 
around  the  CRT? 

MIIDPlot* 

Group  1 

Pushbuttons  around  the  scope. 

Groups 

Pushbuttons  — unanimously. 

Groups 

Dedicated  pushbuttons. 

F-wnkits 

Dedicated  pushbuttons  around  the  CRT. 

5.  Would  you  umnt  audio  tonet  for  attention  getting? 

MIIONata 

Gvoupl 

(No!  You’rs  going  to  have  so  many  audio  tones  . . . General  — must  have  real-time  (from  <m-board  sensors! 
radar  warning  information  diaplayed  on  scope.  RHAW  set  should  be  integrated  into  the  JTIDS  disiday  for 
sure. 

Groups 

Definitely  NO.  Only  when  something  catastrophic  is  fixing  to  happen. 

Groups 

Yon  would  be  busy  with  a lot  of  different  things.  (Generally  mixed  feelings  — could  «vork  if  tone  system  was 
simplified  and  int^pated  with  other  tone  systems!. 

P-HMoila 

No  audio  tones  — too  many  already. 
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6.  Wk*t  Mre  your  feelings  on  using  * helmet  mounted  displny  to  present  JTIDS  info  ? 

M11D  Pilots 

Group  2 ^ 

i 

No.  Too  distracting  — jitter  and  flashing  lights.  1 

Groups 

No.  All  you  would  need  is  for  that  thing  to  act  up  at  a critical  time  and  you  would  go  blind.  No  way.  It  might 
not  be  a bad  idea.  Anything  you  put  on  a helmet  is  going  to  add  weight.  We’ve  had  experience  with  the 
bird-proof  helmet  — it  was  so  heavy  it  about  broke  your  neck.  I don’t  think  that’s  a good  idea  at  all  — 
anything  like  that  could  possible  blind  you  with  a malfunction  — or  anything  like  that  could  screw  up  your 
mission  when  you  should  be  looking  outside  the  cockpit  for  missiles  being  launched  .... 

F-16  Pilots 

Would  rather  have  JTIDS  display  on  CRT  on  instrument  panel.  Might  like  to  have  warnings  such  as  “check 
six”  or  “attack”  flashed  on  helmet  mounted  display  for  imminent  threats  or,  in  like  manner,  “shoot”  when 
weapon  system  is  within  kill  parameters  on  an  attack. 

7.  Would  you  want  JTIDS  info  on  a Heads  Up  Display  [HUD]  ? 

MUD  Pilots 

Group  2 
No 

Group  3 

No  way.  Absolutely  not  . . . couldn’t  see  . . . too  much  garbage  on  HUD’s  now.  You  wouldn’t  be  able  to  read 
any  of  that  through  the  HUD. 

MS  Pilots 

I wouldn’t  want  anything  that  would  degrade  my  eyesight  at  all.  The  HUD  IHeads  Up  Display)  itself  has  got 
enough  garbage  on  it. 

Would  not  want  JTIDS  info  on  the  HUD. 

8.  In  what  priority  would  you  rank  various  hostile  threats  such  as,  AAA,  SAMS,  small  arms,  enemy  fighters, 
etc.  ? 

M11D  Pilots 

Group  1 

It  would  be  dependent  on  the  type  of  mission  and  type  of  aircraft.  For  low-level,  terrain  following,  strike  — SA 
7’s,  SA  9*8,  Quad  23’8  before  hostile  aircraft.  Scope  range  should  be  automatically  variable  to  display  imminent 
threats. 
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Group  2 


Ground  or  Surface-to-Air  threata  first.  Depends  on  your  type  of  mission  and  aircraft.  Crew  should  be  able  to 
select,  on  each  mission,  the  threat  priorities.  Day  VFR,  single  seat,  ground  attack  in  a mixed  threat:  AAA, 
SAMS,  then  fighters.  Priority  should  depend  on  altitude  of  your  aircraft  also. 

Group  3 

iSingle  Seat,  Day  VFR,  ground  atUck)  — still  doesn’t  necessarily  limit  the  way  threate  are  ranked.  You  might 
be  in  an  A-10  or  something  slower  than  that  where  an  SA-7  might  bother  you  — where  if  you  were  in  a faster 
single-seat  aircraft  an  SA-T  wouldn’t  concern  you. 

Scope  should  display  only  immediate  threate  to  you.  If  it’s  not  within  range  or  not  shooting  at  you  — you 
shouldn’t  see  it.  (Disagreement  here:l  I disagree  — you  might  be  flying  mto  a SAM  site  and  not  know  it. 

F-15  Pilot* 

Should  be  consistent  with  other  warning  equipment  (EWEWS,  TEWS,  RWR,  RHAW)  being  used  on  the 
aircraft.  Will  be  mission  dependent.  Should  have  some  means  of  selecting  the  threat  priority  according  to 
altitude  of  operation. 

9.  If  some  threat  priority  system  is  used,  what  maximum  number  of  symbols  should  be  displayed  in  the 
proposed  5”  X 5”  CRT  area? 

Group 2 

Do  you  really  think  that  the  system  would  be  useable  in  a high  density  area?  There  would  be  too  many  symbols 
to  be  useable.  You  would  have  to  try  to  avoid  the  real  bright  (on  the  scope!  areas. 

Group  3 

In  an  Eastern  Europe  scenario  the  JTIDS  would  be  lit  up  like  a Christmas  tree  like  our  RHAW  scope  is 
now. 

10.  Wben  using  JTIDS  for  navigation,  would  you  need  additional  symbols  [other  than  course  lines  and 
waypoints]  to  help  keep  you  geographically  oriented? 

M11D  Pilots 

Group  1 

Would  like  to  have  JTIDS  map  superimposed  on  moving  map  (current  F-lllD)  diqilay. 

Group  2 

As  far  as  we’re  concerned,  it’s  pretty  impratant  to  know  if  there’s  a hill  between  ns  and  where  we  re  going. 

11.  Le.,  would  additional  information  on  the  scope  be  helpful  in  finding  a ground  target,  locating  a FAC, 
station  keeping  and  etc.  ?” 


-u... 
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MllOPilota 


Group  1 

If  you’re  told  to  hold  over  a bridge  (for  example)  it  sure  would  be  nice  to  have  it  on  the  display. 

M5  Pilots 

I would  think  for  a low-level  bomb  dropper  — he  would  be  interested  in  altitudes  on  each  leg  and  terrain 
elevation. 

I can’t  see  that  it  would  be  very  reliable,  that  it  would  have  a very  high  confidence  level.  An  air-to-ground  type 
flying  VFR  low-level  is  going  to  be  looking  outside  the  cockpit  all  the  time  — I can’t  see  him  trusting  the  CRT 
information. 

The  320nm  scale  wouldn’t  be  worth  a damn  for  precise  navigation.  You  would  have  to  get  an  awful  lot  of 
information  on  there  before  the  CRT  would  be  as  useful  as  a low-level  chart. 

Could  you  select  a nav  leg  and  have  the  leg  profile  displayed  on  the  bottom  of  the  scope? 

Would  like  to  have  orbit  points,  AW  ACS  and  tanker  tracks,  CAP  (Combat  Air  Patrol)  tracks  and  etc. 
displayed. 

12.  Does  JTIDS  hMve  the  potentUl  to  ease  your  present  umrkload?  If  $o,  hotv? 

F-111D  Pilots 

Group  2 

(Silence  — pondering).  If  you  have  time  to  look  at  it,  if  the  information  is  good  — (some  potential  for  easing 
workload). 

Group  3 

My  first  impression  is  that  this  thing  is  going  to  be  too  complicated  for  the  task  loading  the  pilot  already  has  in 
a single  seat  airci;pft  — too  demanding.  I’d  go  along  with  that  and  say  it’s  not  worth  the  cost  — in  our 
experience  with  “Super-sophisticated  equipment’’  in  this  airplane  and  recent  experience  with  sensors  in  Task 
Force  Alpha  add  up  to  the  fact  that  they’re  not  so  reliable  — tend  to  ignore  it  altogether.  Probably  would  save 
your  money  if  you  gave  us  some  good  RH  AW  gear  and  a simple  airplane. 

Hiis  thing  is  a nice-to-know,  have  thing  but  if  you’re  working  radar  and  other  things  plus  setting  up  weapons 
and  flying  the  airplane  it’s  going  to  be  tough  to  look  at  anything  else  — I flew  the  Hiud  (F-105)  and  we  had  our 
own  radar  and  doppler  and  all  this  other  stuff  so  we  had  a lot  of  things  to  be  playing  with  plus  setting  up 
weapons  and  flying  the  airplane,  flying  information  — and  something  like  that  (J'l'lDS)  — I don’t  think  you’d 
ever  look  at  it. 

Could  ease  workload  if  it  only  gave  you  threats  that  were  within  range. 

F-1SPHot« 

Would  not  ease  the  present  workload  — would  give  you  a lot  more  information.  Would  increase  your 
shuatiMial  awareness.  It  might  double  your  workload  but  if  it  increases  the  effectiveness  of  your  weapon 
system  — well  fine.  It’sgoingtomakeyouburier  but  you  should  be  able  to  do  a better  job. 
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APPENDIX  3 


USTING  STIMUU  AND  ASSOCIATED  Hr 


No. 

Stimulus 

STU 

Fill 

FIS 

No. 

Stimulus 

STU 

Fill 

F15 

1 

Friendly 

1.08 

.74 

.87 

24 

Aircraft  Carrier 

.99 

.63 

.62 

2 

Unknown 

1.10 

.82 

.88 

25 

Tanker 

.91 

.67 

.79 

3 

Enemy 

1.07 

1.01 

.91 

26 

Destroyer 

.87 

.66 

.65 

4 

Aircraft  (In  General) 

.85 

.44 

.55 

27 

Missile  Ship 

.91 

.72 

.61 

5 

Fighter 

1.01 

.77 

.71 

28 

Submarine 

.96 

.70 

.60 

6 

Bomber 

.99 

.77 

.73 

29 

AAA 

1.02 

.52 

.49 

7 

Helicopter 

.95 

.72 

.70 

30 

Troops 

.95 

.69 

.65 

8 

Transport 

1.00 

.77 

.57 

31 

Tanks 

.97 

.51 

.57 

9 

Forward  Observer 

1.00 

.92 

.69 

32 

Convoy 

1.00 

.78 

.83 

10 

Recon 

.92 

.62 

.71 

33 

Radar  Installation 

.87 

.32 

.36 

11 

Electronic  Jammer 

1.01 

.69 

.61 

34 

SAM  Site 

1.04 

.77 

.74 

12 

Tanker 

AIR-TO-GROUND 

> 

1.02 

.70 

.74 

35 

Hand  Held  SAMS 

1.02 

.89 

.54 

13 

Guided  Nuclear 

.99 

.76 

.73 

36 

Mobile  SAMS 

1.00 

.83 

.36 

14 

Guided  Conventional 

.89 

.72 

,66 

37 

Safe  Area 

1.01 

.69 

.50 

A 

15 

Freefall  Nuclear 

.95 

.71 

.55 

38 

Base  of  Origin 

1.04 

.86 

.59 

16 

Freefall  Conventional 
AIR-TO-AIR 

.90 

.69 

.54 

39 

Nuclear  Blast 

.78 

.60 

.57 

1 

17 

Guided  Nuclear 

.94 

.81 

.66 

40 

Bombing  Area 

1.05 

.86 

.86 

18 

Guided  Conventional 

.99 

.64 

.55 

41 

Downed  Aircrew 

.87 

.70 

.48 

' 

19 

Unguided 

1.09 

.79 

.63 

42 

Initial  Point 

.73 

.32 

.63 

20 

Altitude 

1.00 

.33 

.24 

43 

Target 

.73 

.41 

.73 

21 

Heading 

1.00 

.61 

.36 

44 

Waypoint 

.87 

.70 

.72 

22 

Airspeed 

.98 

.57 

.29 

45 

Emergency  Base 

.85 

.62 

.52 

23 

Ships  (In  Geneial) 

.72 

.37 

.52 

36 


SYMBOL: 


Safe  Area 


Base  of  Origin 


Nuclear  Blast 


Bombing  Area 


Downed  Aircrew 


Initial  Point 


APPENDIX  4 

CHI  SQUARE  VALUES  COMPARING  CODING 
GROUP  DISTRIBUTIONS  ACROSS  SAMPLES 


STD 

F-11 

F-15 

STD 

F-111 

F-15 

STD 

F-111 

F-15 

STD 

F-111 

F-15 

STD 

F-111 

F-15 

STD 


STD  F-lll  F-IS 

— 8.18*  20.22*** 
— 8.44 


6.39*  8.69* 

— 3.23 


9.75* 


3.84 


.250 


8.01* 


3.80 


.280 


26.11**  22.35*** 

— 2.10 


56.82** 


23.23*** 


7.58** 


Convoy 


Radar  Installation 


18.80*** 


APPENDIX  5 


DISTRIBUTION  OF  GROUP  I (PICTORIAL)  CODES 
BY  SAMPLE  PROPORTIONS 


Object,  Event,  etc. 

Students 

F-15Pilote 

F'lllPiloU 

Target 

43.4 

9.1 

2.6 

Initial  Point 

0 

0 

0 

Shipe 

45.3 

59.1 

79.5 

Radar  Installation 

35.8 

72.7 

79.5 

Waypoint 

0 

4.5 

2.6 

Aircraft 

20.8 

18.2 

66.7 

Nuclear  Blast 

37.7 

54.5 

64.1 

Tanks 

34.0 

59.1 

61.5 

AAA 

24.5 

45.5 

56.4 

Emergency  Base 

9.4 

0 

2.6 

Do%«med  Aircrew 

7.5 

54.5 

48.7 

Ground  Troops 

37.7 

50.0 

48.7 

Safe  Area 

3.8 

0 

0 

Base  of  Origin 

1.9 

0 

7.7 

Sam  Site 

9.4 

36.4 

41.0 

Origin  (friendly,  enemy,  unknown) 

0 

0 

0 

Hand'Held  Sams 

11.3 

22.7 

23.1 

Bombing  Area 

13.2 

22.7 

20.5 

Gnivoy 

15.1 

31.8 

33.3 

40 
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DISTRIBUTION  OF  GROUP  II  (ALPHA-NUMERIC) 
CODERS  BY  SAMPLE  PROPORTIONS 


Object,  Event,  etc. 

Students 

F-15  Pilots 

F-111  Pilou 

Target 

22.6 

31.8 

2.6 

Initial  Point 

56.6 

40.9 

10.3 

Ships 

0 

0 

0 

Radar  Installation 

17.0 

18.2 

12.8 

Waypoint 

47.2 

36.4 

5.1 

Aircraft 

0 

0 

0 

Nuclear  Blast 

26.4 

22.7 

5.1 

Tanks 

18.9 

18.2 

17.9 

AAA 

20.8 

36.4 

28.2 

Emergency  Base 

49.1 

59.1 

28.2 

Downed  Aircrew 

18.9 

31.8 

20.5 

Ground  Troops 

11.3 

18.2 

20.5 

Safe  Area 

20.8 

63.6 

51.3 

Base  of  Origin 

22.6 

54.5 

25.6 

Sam  Site 

26.4 

27.3 

20.5 

Origin  (friendly,  enemy,  unknown) 

30.3 

27.3 

29.3 

Hand'Held  Sams 

26.4 

54.5 

23.1 

Bombing  Area 

26.4 

27.3 

28.2 

Convoy 

22.6 

18.2 

28.2 

41 


DISTRIBUTION  OF  GROUP  III  (SIMPLE  UNES,  ETC.) 
CODERS  BY  SAMPLE  PROPORTIONS 


Object,  Event,  etc.  Studenta F-15  Pilott F-lll  Pilott 


Target 

17.0 

4.5 

2.6 

Initial  Point 

9.4 

0 

0 

Ships 

11.3 

9.1 

7.7 

Radar  Installation 

11.3 

9.1 

5.1 

Waypoint 

34.0 

4.5 

5.1 

Aircraft 

41.5 

4.5 

7.7 

Nuclear  Blast 

22.6 

0 

12.8 

Tanks 

20.8 

9.1 

2.6 

AAA 

24.5 

18.2 

7.7 

Emergency  Base 

22.6 

0 

5.1 

Downed  Aircrew 

64.2 

0 

17.9 

Ground  Troops 

26.4 

22.5 

17.9 

Safe  Area 

18.9 

22.7 

7.7 

Base  of  Origin 

26.4 

4.5 

5.1 

Sam  Site 

39.6 

22.7 

20.5 

Origin  (friendly,  enemy,  unknown) 

0 

18.2 

0 

Hand-Held  Sams 

30.2 

18.2 

33.3 

Bombing  Area 

32.1 

13.6 

7.7 

Convoy 

32.1 

18.2 

7.7 

DISTRIBUTION  OF  GROUP  IV  (GEOMETRIC  SHAPES) 

CODERS  BY  SAMPLE  PROPORTIONS 

Object,  Event,  etc. Students F-IS  Pilots F-111  Pilots 


Target  11.3 

Initial  Point  28.3 

Ships  18.9 

Radar  Installation  26.4 

Waypoint  7.5 

Aircraft  13.2 

Nuclear  Blast  11.3 

Tanks  20.8 

AAA  28.3 

Emergency  Base  9.4 

Downed  Aircrew  1.9 

Ground  Troops  18.9 

Safe  Area  49.1 

Base  of  Origin  39.6 

Sam  She  18.9 

Origin  (friendly,  enemy,  unknown)  17.3 

Hand-Held  Sams  22.6 

Bombing  Area  22.6 

Convoy  30.2 


54.5 

89.7 

51.9 

87.2 

9.1 

5.1 

0 

2.6 

45.5 

69.2 

9.1 

5.1 

13.6 

12.8 

4.5 

2.6 

0 

10.1 

31.8 

59.0 

9.1 

10.3 

4.5 

10.3 

0 

30.8 

40.9 

48.7 

13.6 

12.8 

50.0 

8.7 

4.5 

10.3 

31.8 

33.3 

31.8 

28.2 

nwTiirBJ 


DISTRIBUTION  OF  UNCLA88IRE0 


Object,  Event,  etc. 

CODERS  BY  SAMPLE  PROPORTIONS 

Students  F*1S  Pilots 

F-111  Pilou 

Target 

5.70 

0 

2.5 

Initial  Point 

5.70 

7.2 

2.5 

Ships 

24.5 

4.5 

7.7 

Radar  Installation 

9.5 

0 

0 

Waypoint 

11.3 

9.1 

18.0 

Aircraft 

24.5 

68.2 

12.8 

Nuclear  Blast 

2.0 

9.2 

12.9 

Tanks 

5.5 

9.1 

15.4 

AAA 

1.9 

0 

0 

Emergency  Base 

9.5 

9.1 

5.1 

Downed  Aircrew 

7.5 

4.6 

2.6 

Ground  Troops 

5.7 

0 

2.6 

Safe  Area 

7.4 

13.7 

10.2 

Base  of  Origin 

9.5 

0 

12.9 

Sam  Site 

5.7 

0 

5.2 

Origin  (friendly,  enemy,  unknown) 

52.4 

4.5 

52.0 

Hand-Held  Sams 

9.5 

0 

10.2 

Bombing  Area 

5.7 

4.6 

10.3 

Convoy 

0 

0 

2.6 

! 
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APPENDIX  6 

DISTRIBIinON  OF  GROUP  I (PICTORIAU 
CODERS  BY  SAMPLE  PROPORTIONS 


Otgect,  Event  


Aircraft 

Fighter 

Bomber 

Helicopter 

Transport 

Forward  Observer 

Reconnaissance 

Electronic  Jammer 

Tanker 


Weapons:  Air~to-Ground 
Guided  Nuclear 
Guided  Conventional 
Freefall  Nuclear 
Freefall  Conventional 


Weapons:  Air~to-Air 
Guided  Nuclear 
Guided  Conventional 
Unguided 


Aircraft  Paramaters 
Altitude 
Heading 
Airspeed 


Ships 

Aircraft  Carrier 
Tanker 
Destroyer 
Missile  Ship 
Submarine 


Students 


F-15  Pilots 


F-lllDPiloto 


DISTRIBUTION  OF  GROUP  II  (ALPHA-NUMERIC) 

CODERS  BY  SAMPLE  PROPORTIONS 

CMaject,  Event Students F-15  Pilots F-lllD  Pilots 


Aircraft 

Fighter 

20.8 

31.8 

30.8 

Bomber 

26.4 

40.9 

38.5 

Helicopter 

24.5 

31.8 

33.3 

Transport 

24.5 

54.15 

33.3 

Forward  Observer 

24.5 

36.4 

38.5 

Reconnaissance 

39.6 

50.0 

61.5 

Electronic  Jammer 

30.2 

54.5 

48.7 

Tanker 

30.2 

45.5 

51.3 

Weapons:  Air-to-Ground 

Guided  Nnclear 

34.0 

50.0 

51.3 

Guided  Conventional 

24.5 

54.5 

53.8 

Freefall  Nuclear 

30.2 

63.6 

48.7 

Freefall  Conventional 

30.2 

68.2 

46.2 

Weapons:  Air-to-Air 

Guided  Nuclear 

28.3 

59.1 

46.2 

Guided  Conventional 

24.5 

59.1 

51.3 

Unguided 

26.4 

59.1 

41.0 

Aircraft  Parameters 

Altitude 

62.3 

95.5 

92.3 

Heading 

58.5 

59.1 

61.5 

Airspeed 

60.4 

95.5 

94.9 

Ships 

Aircraft  Carrier 

24.5 

27.3 

43.6 

Tanker 

32.1 

40.9 

56.4 

Destroyer 

32.1 

45.5 

43.6 

Missile  Ship 

35.8 

45.5 

43.6 

Submarine 

24.5 

36.4 

48.7 

DISTRIBUTION  OF  GROUP  III  (SIMPLE  UNES,  ETC.) 
CODERS  BY  SAMPLE  PROPORTIONS 


Object,  Event 

Aircraft 

Filter 

Bomber 

Helioopter 

Transport 

Forward  Observer 

Reconnaissance 

Electronic  Jammer 

Tanker 

IFeapons:  Air-to-Ground 
Guided  Nuclear 
Guided  Conventional 
Freefall  Nuclear 
Freefall  Conventional 
Weapon*:  Air-toAir 
Guided  Nuclear 
Guided  Conventional 
Unguided 

Aircraft  Parameter* 

Altitude 

Heading 

Airspeed 

Ships 

Aircraft  Carrier 
Tanker 
Destroyer 
Missile  Ship 
Submarine 


Students 


F-lSPOoU 


F-lllDPiloto 
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DISTRIBUTION  OF  GROUP  IV  (GEOMETRIC  SHAPES) 
CODERS  BY  SAMPLE  PROPORTIONS 


Object,  Event 

Students 

F-15Pilou 

F-lllD  Pilots 

Aircraft 

Fighter 

22.6 

9.1 

20.5 

Bomber 

30.2 

4.9 

10.3 

Helicopter 

24.5 

13.6 

7.7 

Transport 

22.6 

18.2 

5.1 

Forward  Observer 

26.4 

9.1 

10.3 

Reconnaissance 

13.2 

9.1 

23.1 

Electronic  Jammer 

. 15.4 

9 

5.1 

Tanker 

30.2 

4.5 

5.1 

Weapotu;  Air-to-Ground 

Guided  Nuclear 

34.0 

9.1 

17.9 

Guided  Conventional 

24.5 

4.5 

7.7 

Freefall  Nuclear 

13.2 

4.5 

5.1 

Freefall  Conventional 

11.3 

9.1 

2.6 

Weapons:  Air-to-Air 

Guided  Nuclear 

20.8 

13.6 

7.7 

Guided  Conventional 

22.6 

4.5 

10.3 

Unguided 

13.2 

9.1 

5.1 

Aircraft  Parameters 

Altitude 

7.5 

0 

2.6 

Heading 

5.7 

0 

0 

Airspeed 

9.4 

0 

0 

Ships 

Aircraft  Carrier 

22.6 

4.5 

5.1 

Tanker 

24.5 

4.5 

15.4 

Destroyer 

7.5 

4.5 

0 

Missile  Ship 

13.2 

4.5 

2.6 

Submarine 

9.4 

9.1 

10.3 

DISTRIBUnON  OF  UNCLASSinED 
CODERS  BY  SAMPLE  PROPORTIONS 


Object,  Event 

Students 

F-15Paou 

■■ 

F-lllDPilou 

Aircraft 

Fighter 

26.4 

13.8 

17.9 

Bomber 

7.5 

9.1 

Helicopter 

17.0 

9.1 

Transport 

1.9 

0 

Forward  Observer 

13.2 

9.1 

5.1 

Reconnaissance 

9.4 

4.5 

5.1 

Electronic  Jammer 

9.4 

4.5 

Tanker 

3.8 

4.5 

Weapont:  Air-to-Ground 

Guided  Nuclear 

3.8 

18.2 

Guided  Conventional 

5.7 

9.1 

Freefall  Nuclear 

13.2 

18.2 

Freefall  Conventional 

9.4 

9.1 

Weapons;  Air~to~Air 

Guided  Nuclear 

13.2 

9.1 

Guided  Conventkmal 

5.7 

9.1 

Unguided 

13.2 

9.1 

Aircraft  Parameters 

Altitude 

3.8 

0 

2.6 

Heading 

11.3 

0 

0 

Ainpf4:d 

11.3 

0 

2.6 

Aii-Traft  Carrier 

11.3 

9.1 

5.1 

Tank«u 

0 

18.2 

10.3 

Destroyer 

0 

9.1 

5.1 

Missile  Ship 

1.9 

0 

10.3 

Submarine 

7.5 

0 

5.1 

APPENDIX  7 


COMMON  DESIGNS  FOR  TACTICAL  SYMBOLS  ORIGINATED  BY  SUBJECTS 


I AIRCRAFT 


AIRCRAFT  - IN  GENERAL 


NOTE:  Dimensions  are 

visual  angle  subtended 
in  minutes  of  arc  as 
suggested  by  Symbology 
standardization 
Committee. 


FIGHTER 


BOMBER 


SO 


m.1 


NOTE:  Dimensions  are 
visual  angle 
subtended  in  minutes 
of  arc  as  suggested 
by  Sumbology 
Standardization 
Committee. 


c 


FOWARD  OBSERVER 


r » 


23- 


M3-*l 


H-IO-H 


-H5K- 


K 27 H 


tt 


fl 


22 


•^15- 


7, 


NOTE:  Dimensions  are 
visual  angle 
subtended  in  minutes 
of  arc  as  suggested 
by  Symbology 
Standardization 
Committee. 


QQ 


RECONNAISSANCE 


ELECTRONIC  JAMMER 


TANKER 


NOTE:  OimeiuionB  are 
visual  angle 
subtended  in  minutes 
as  suggested 
by  Symbology 
Standardization 
Committee. 


T 

20 

i 


l«s 18 — H 


h-KM 


IV  AIRCRAFT  PARAMETERS 


ALTITUDE  - 10,000  ft 


NOTE:  DimeoaioDi  are 

visual  angle  aubtended 
in  minutea  of  are  aa 
■uggeated  by  Symbology 
StandardiMtion  Gmunittee. 


w.  IBll 


HEADING  - 270‘ 


274,1 


AIRSPEED  • 500  KNOTS 


15Q 


/Alt 


S WEAPONS  - AIR  TO  GROUND 
GUIDED  NUCLEAR 


NOTE:  Dimenaiooa  are 
visual  angle  subtended 
in  minutes  of  arc  as 
suggested  by  Symbology 
Standardization  Committee. 


r 


FREEFALL  NUCLEAR 


( 


NOTE:  DiniMiaioiM  uc 
viaual  ancle  Mibiaiided 
in  minutee  ol  are  aa 
■oCgMted  by  Symbolocy 
Sundarrtiaation  Committee. 


FREEFALL  CONVENTIONAL 


GUIDED  CONVENTIONAL 


NOTE;  Dimensions  are 
visual  angle  subtended 
in  minutes  of  arc  as 
suggested  by  Symbology 
Standardization  Committee. 


57 


r 


III  WEAPONS  - AIR  TO  AIR 
GUIDED  NUCLEAR 


NOTE:  Dimensions 
are  visual  angle 
subtended  in 
minutes  of  arc  as 
suggested  by 
Symbology  Standard- 
ization Committee. 


GUIDED  CONVENTIONAL 


UNGUIDED 


hM 


* % 


NOTE:  Dimensiona  are  viaiuil 
angle  subtended  in  minntea 
of  arc  as  suggested  by 
Symbology  Standardisation 
Gnnmittee. 


AIRCRAFT  CARRIER 


NOTE:  DimeoMoM  an 
viaual  angle  mbtended 
in  minotea  of  are  aa 
Buggeated  by  Symbology 
Standardwation  Gmimittee. 


DESTROYER  - BATTLESHIP 


h — 20— H 


MISSILE  SHIP 


H 20 H 


SUBMARINE 


NOTE:  Dimeiisioiu  are 
vkual  angle  subtended 
in  minutes  <rf  arc  as 
suggested  by  Symbcdogy 
StandardisatiiHi  Committee. 


VI  GROUND  TARGETS 
AAA 


5 H- 

'AAi 


H — 20  ~H 


I I II 

h— M— H 


icf 

H-IO-M 


61 


HAND-HELD  SAMS 


k-io-H 


NOTE;  Dimenaiona  are  vkual 
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suggested  by 
Symbology  Standard- 
ization Committee. 
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RADAR  INSTAUATION 


NOTE:  Dimensioiu  are 
vkual  angle  aubtended 
in  minutee  of  arc  aa 
auggeated  by  Sombology 
SundardisadMi 
Committee. 
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minutes  of  arc  as  suggested 
by  Symbology  Standardization 
Qmimittee. 
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Non.:  Dimensions  are 
visual  angle  subtended 
in  minutes  of  arc  as 
suggested  by  Symbology 
Standardization 
Committee. 
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FREQUENT  DESIGNS  FOR  TACTICAL  SYMBOLS 
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STUDENTS  F-1 1 1 PILOTS  F-1 5 PILOTS 
OBJECT  S.S.C.  1st  I 2nd  1st  I 2nd  1st  I 2nd 

CHOICE  CHOICE  CHOICE  CHOICE  CHOICE  CHOICE 
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